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SPECIFICATION 

Image processor, Image processing method and Image processing 

program recording medium 

TECHNICAL FIELD 

The present invention relates to an image processor, an image 
processing method and an image processing program recording medium 
and, more particularly, to those which can enlarge an image which 
has tone in each pixel by performing resolution conversion with easy 
arithmetic processing and obtain a high-quality resolution image 
while enlarging the same. For example, it relates to those which 
are suitable for being applied in an image output apparatus such 
as a printer for outputting input image information with 
interpolating or a display unit for performing a screen display 
equivalent that is equivalent to Hi-Vision image display with 
interpolating a current NTSC video signal - 

BACKGROUND ART 

Figure 14 illustrate an example of a condition in which this 
type image processor is used. In the figure, numeral 1401 denotes 
a PC(personal computer), 1402 denotes an image processor for 
enlarging an image that is output from the PC, and 1403 denotes an 
LCD projector for displaying the output of the image processor 1402. 

Video signal is output in such as 640x 480 pixels from the 
monitor output line of PC 1401. The image processor 14 02 for 
performing resolution conversion is connected between them so as 
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to display the video signal on the LCD projector 1403 which has a 
resolution of such as 1280x 960 pixels. 

Thereby, a low- re solution image output from PC 14 01 is 
converted to a high-resolution image, and even when an image of a 
PC is subjected to an enlarged projection display on a screen by 
the LCD projector 1403, the projected image is prevented from being 

roughly displayed. 

various methods have been proposed for resolution conversion 
processing which enlarge a low- resolution image with interpolating. 
The most common method is a linear interpolation for linearly 
interpolating intensity of new pixels from peripheral original 
pixels . 

Figure 4 is a diagram showing an interpolation position of 
pixels according to the conventional linear interpolation method. 

in figure 4, numeral 401 denotes an original pixel with 
intensity G, 4 02 denotes an original pixel with intensity H, 403 
denotes an original pixel with intensity I and 404 is an original 
pixel with intensity J. The interval between these original pixels 
of low-resolution image, that is, the interval between adjacent 
pixels in each of the horizontal or vertical directions is "1". 
Numeral 405 denotes a new pixel with intensity K which is obtained 
by conventional linear interpolation, "m" presents the distance 
from the original pixel 401 to the new pixel 405 in the vertical 
direction, "n" presents the distance from the original pixel 401 
to the new pixel 405 in the horizontal direction, and these distances 
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"m M and "n M are assumed to be 0<_m< 1 and 0^jn< 1. 

The intensity K of new pixel will be calculated by the 
following equation. 

K=(l-m) ( (1-n) G+nH) +m ((1-n) 1+nJ) 

According to the conventional linear interpolation, it 
performs interpolation by linear interpolation and the required 
operation times for calculating the new pixel is six times of 
multiplication and five times of adding and subtraction. 

In the conventional linear interpolation, there is a problem 
in that an image is smoothed by averaging processing with peripheral 
original pixels, thereby resulting in blurred images with the edge 
parts thereof lacking in sharpness. 

There is an image processor disclosed in the Japanese 
Published Patent Application No. 7-93531 which can solve the problems 
that the edge parts of image is blurred by averaging processing. 
The image processor is the one which performs linear interpolation 
arithmetic as well as performing smoothing after adding arithmetic 
processing for creating edges in accordance with the condition of 
peripheral images, thereby the edge parts are cleared, resulting 
in high-quality images. 

However, the image processor disclosed in Japanese Published 
Patent Application 7-93531 has a problem in that the entire 
processing time is increased as well as the device becomes costly 
when constructed in hardware, because it requires an edge making 
arithmetic processing in addition to the linear interpolation. 
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Further, when a low-resolution image is interpolated and 
converted to a high-resolution image, in particular, to an image 
having twice number of pixels in each of the vertical and horizontal 
directions, the amount of arithmetic processing can be reduced by 
devising the pixel arrangement. The arrangement in this case will 
be described with referring to figure 6. 

Figure 6 is a diagram showing pixel arrangement at performing 
resolution conversion to twice number of pixels in each of the 
vertical and horizontal directions by conventional image processing 
method. 

In figure 6, " O " designates an original pixel of low- 
resolution image, "□" designates a new pixel of high-resolution 
image. The pixel arrangement in the figure 6 omits arithmetic 
processing for calculating the intensity of a new pixel 6 04 by 
matching the position of an original pixel 601 with the position 
of new pixel 604, and matching also for their intensity. In addition, 
a new pixel 606 is calculated based upon the original pixel 601 and 
the original pixel 602, and a new pixel 610 is calculated based upon 
new pixels 606, 607, 608 and 609. 

According to the pixel arrangement in figure 6, though the 
intensity of new pixel 604 which corresponds to the original pixel 
601 includes no error, the intensity value of new pixel 606 which 
is calculated based upon the original pixels 601 and 602 may include 
an error, further, the intensity value of new pixel 610 which is 
calculated based upon the new pixel 606 may include a greater error. 
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Thus, there arises an interpolation result in which the appearance 
probability of error varies depending on intensity of new pixel. 

As mentioned above, the conventional image processing method 
for converting a low-resolution image to a high-resolution image 
performs averaging of the intensity of original pixels at periphery 
of new pixel, thereby resulting in a problem that an interpolated 
image is smoothed and results in blurred images in which edge parts 
thereof lost sharpness. 

Further, the image processor disclosed in Japanese Published 
Patent Application 7-93531 has a problem in that the entire 
processing time becomes longer due to an edge making arithmetic 
processing and a problem in that it becomes costly when it is produced 
in hardware . 

Further, in a case where a pixel arrangement is devised so 
as to decrease the amount of arithmetic processing, there may be 
a case in which the appearance probability of an error of pixel data 
varies depending on pixels. 

The present invention is made to solve the problems and has 
for its object to provide an image processor, an image processing 
method and an image processing program recording medium which can 
obtain high-quality image with sharpness which requires few amount 
of interpolation arithmetic so as to improve an image resolution, 
short processing time, and a small scaled hardware, and further, 
which can make uniform the appearance probability of error of pixel 
data in a case where a pixel arrangement is performed so as to minimize 
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the amount of arithmetic processing. 

DISCLOSURE OF INVENTION 

The image processing apparatus according to Claim 1 of the 
present invention provides an image processor which converts a 
low-resolution image to a high-resolution image that includes a 
pixel selection means for selecting a pixel of interest which is 
located at a position closest to a pixel for interpolation to be 
newly generated between pixels (hereinafter, simply referred to as 
"new pixel") and adjacent pixels adjacent the pixel of interest from 
the pixels of the low-resolution image, respectively, and new pixel 
data calculation means for calculating the difference between the 
adjacent pixels putting between the pixel of interest, obtaining 
the amending value on the basis of the difference and the distance 
between the pixel of interest and the new pixel, and calculating 
the data value of the new pixel on the basis of the data of the pixel 
of interest, the difference, and the amending value. 

According to the image processor of claim 1 of the present 
invention having the above-described construction, it is possible 
to carry out the interpolation of image with a small operation amount 
as well as obtain image with sharpness. 

The image processing method according to Claim 2 of the present 
invention provides an image processing method which converts a 
low-resolution image to a high-resolution image that includes a 
pixel selection step for selecting a pixel of interest which is 
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located at a position closest to a pixel for interpolation to be 
newly generated between pixels (hereinafter, simply referred to as 
"new pixel") and adjacent pixels adjacent the pixel of interest, 
respectively, from the pixels of the low-resolution image, and new 
pixel data calculation step for obtaining the difference between 
the adjacent pixels putting between the pixel of interest , obtaining 
the amending value on the basis of the difference and the distance 
between the pixel of interest and the new pixel, and calculating 
the data value of the new pixel on the basis of the data of the pixel 
of interest, the difference, and the amending value. 

According to the image processing method of Claim 2 of the 
present invention having the above-described construction, it is 
possible to carry out the interpolation of image with a small 
operation amount as well as obtain an image with sharpness. 

The image processing program recording medium according to 
Claim 3 of the present invention has stored an image processing 
program performing conversion of a low-resolution image into a high- 
resolution image therein, which program includes a pixel selection 
step for selecting a pixel of interest which is located at a position 
closest to a pixel for interpolation to be newly generated between 
pixels (hereinafter, simply referred to as "new pixel" ) and adjacent 
pixels adjacent the pixel of interest, from the pixels of the 
low-resolution image, respectively, and new pixel data calculation 
step for obtaining the difference between the adjacent pixels 
putting between the particular pixel, obtaining the amending value 
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on the basis of the difference and the distance between the pixel 
of interest and the new pixel, and calculating the data value of 
the new pixel on the basis of the data of the pixel of interest, 
the difference, and the amending value. 

According to the image processing program recording medium 
of Claim 3 of the present invention having the above-described 
construction, it is possible to carry out an interpolation of image 
with a small operation amount as well as obtain an image with 
sharpness . 

The image processor according to Claim 4 of the present 
invention provides an image processor according to Claim 1 in which 
the pixel selection means is one which selects data A of the pixel 
of interest of the low-resolution image, located at a position 
closest to a pixel for interpolation to be newly created (hereinafter, 
referred to as "new pixel") between pixels of the low-resolution 
image having distances of "1" between adjacent pixels, data B of 
upper pixel of the low-resolution image adjacent the pixel of 
interest at upper side thereof, data c of lower pixel of the 
low-resolution image adjacent the picture of interest at lower side 
thereof, data D of left pixel of the low-resolution image adjacent 
the pixel of interest at left side thereof, and data E of right pixel 
of the low-resolution image adjacent the pixel of interest at right 
side thereof, and the new pixel data calculation means is one which 
calculates data F of new pixel composing the high-resolution image 
by a formula of F=A+(i/2) (E-D) + (j/2) (C-B) on the basis of data 
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A of pixel of interest, data B of upper pixel, data C of lower pixel, 
data D of left pixel, data E of right pixel, the position of the 
new pixel (i, j) which are represented by a distance "i" in the 
horizontal direction and a distance "j H in the vertical direction 
from the pixel of interest to the new pixel. 

According to the image processor of Claim 4 of the present 
invention having the above-described construction, it is possible 
to carry out the interpolation of image with a small operation amount 
as well as obtain image with sharpness. 

The image processing method according to Claim 5 of the present 
invention provides an image processing method according to Claim 
2 in which the pixel selection process is one which selects data 
A of the pixel of interest of the low-resolution image, located at 
a position closest to a pixel for interpolation to be newly created 
(hereinafter, referred to as "new pixel") between pixels of the 
low-resolution image having distances of "1" between adjacent pixels, 
data B of upper pixel of the low- resolution image adjacent the pixel 
of interest at upper side thereof, data C of lower pixel of the 
low-resolution image adjacent the pixel of interest at lower side 
thereof, data D of left pixel of the low-resolution image adjacent 
the pixel of interest at left side thereof, and data E of right pixel 
of the low- resolution image adjacent the pixel of interest at right 
side thereof, and the new pixel data calculation process is one which 
calculates data F of new pixel composing the high-resolution image 
by a formula of F=A+(i/2) <E-D) + < j/2) (C-B) on the basis of data 
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A of pixel of interest, data B of upper pixel, data C of lower pixel, 
data D of left pixel, data E of right pixel, the position of the 
new pixel (i, j) which is represented by a distance "i" in the 
horizontal direction and a distance "j" in the vertical direction 
from the pixel of interest to the new pixel. 

According to the image processing method of Claim 5 of the 
present invention having the above-described construction, it is 
possible to carry out the interpolation of image with a small 
operation amount as well as obtain an image with sharpness. 

The image processing recording medium according to Claim 6 
provides an image processing recording medium according to Claim 
3 in which the pixel selection process is one which selects data 
A of the pixel of interest of the low-resolution image, located at 
a position closest to a pixel for interpolation to be newly created 
(hereinafter, referred to as "new pixel") between pixels of the 
low-resolution image having distances of "1" between adjacent pixels, 
data B of upper pixel of the low-resolution image adjacent the pixel 
of interest at upper side thereof, data C of lower pixel of the 
low-resolution image adjacent the pixel of interest at lower side 
thereof, data D of left pixel of the low-resolution image adjacent 
the pixel of interest at left side thereof, and data E of right pixel 
of the low- resolution image adjacent the pixel of interest at right 
side thereof, and the new pixel data calculation process is one which 
calculates data F of new pixel composing the high-resolution image 
by a formula of F=A+(i/2) (E-D) + ( j/2) (C-B) on the basis of data 
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A of pixel of interest, data B of upper pixel, data C of lower pixel, 
data D of left pixel, data E of right pixel, the position of the 
new pixel (i, j) which is represented by a distance "i" in the 
horizontal direction and a distance "j" in the vertical direction 
from the pixel of interest to the new pixel. 

According to the image processing program recording medium 
of Claim 6 of the present invention, it is possible to carry out 
an interpolation of image with a small operation amount as well as 
obtain an image with sharpness. 

The image processor according to Claim 7 of the present 
invention provides an image processor according to Claim 4 in which 
when generating the high-resolution image having twice number of 
pixels in each of the horizontal and vertical direction for the 
low-resolution image, the position of new pixel is set by making 
the absolute value of the distance "i" in the horizontal direction 
and that of the distance "j" in the vertical direction from the pixel 
of interest be 1/4, respectively, and the new pixel data calculating 
means is one which, when calculating data Fl, F2, F3 and F4 of the 
new pixel located at upper left, upper right, lower left, lower right 
of the pixel of interest, respectively, by F=A+(i/2)(E- 
D)+(j/2)(C-B), previously calculates X=(i/2 ) (E-D)and Y=(j/2)(C- 
B) and then calculates Fl-A-X-Y, F2-A+X-Y, F3=A-X+y, and F4=A+x+Y . 

According to the image processor of Claim 7 of the present 
invention having the above-described construction, it is possible 
to provide an image processor in which, when interpolating the image 
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to twice number in the horizontal direction and the vertical 
direction, can make the appearance probability of error of pixel 
data uniform and further realize the interpolation with a small 
operation amount and obtain the image with sharpness. 

The image processing method according to Claim 8 provides an 
image processing method according to Claim 5 in which when generating 
the high-resolution image having twice number of pixels in both the 
horizontal and vertical direction for the low-resolution image, the 
position of new pixel is set by making the absolute values of the 
distance "i" in the horizontal direction and the distance -j- in 
the vertical direction from the pixel of interest be 1/4, 
respectively, and the new pixel data calculating process is one which, 
when calculating data Fl, F2, F3 and F4..of the new pixel located 
at upper left, upper right, lower left, lower right of the pixel 
of interest, respectively, by F=A+( i/2 ) <E-D )+( j /2 ) ( C-B ) , 
previously calculates X=(i/2) (E-D)and Y-<j/2) (C-B) and then 
calculates F1=A-X-Y, F2=A+X-Y, F3=A-X+Y, and F4=A+X+Y. 

According to the image processing method of Claim 8 of the 
present invention having the above-described construction, it is 
possible to provide an image processing method which can, when 
interpolating the image to twice number both in the horizontal 
direction and the vertical direction, make uniform the appearance 
probability of error of pixel data, and further, can realize the 
interpolation with a small operation amount and can obtain the image 
with sharpness. 
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The image processing program recording medium according to 
Claim 9 of the present invention provides an image processing 
recording medium according to Claim 6, in which when generating the 
high-resolution image having twice number of pixels in both the 
horizontal and vertical direction for the low-resolution image, the 
position of new pixel is made by setting the absolute values of the 
distance "i" in the horizontal direction and the distance "j" in 
the vertical direction from the pixel of interest be 1/4, 
respectively, and the new pixel data calculating process is one which, 
when calculating data Fl, F2, F3 and F4 of the new pixel located 
at upper left, upper right, lower left, lower right of the pixel 
of interest, respectively, by F=A+(i/2 ) (E-D )+( j 12 ) ( C-B ) , 
previously calculates X=( i/2 ) (E-D) and , Y=( j/2 ) (C-B) and then 
calculates F1=A-X-Y, F2=A+X-Y, F3-A-X+Y, and F4=A+X+Y. 

According to the image processing program recording medium 
of Claim 9 of the present invention having the above-described 
construction, it is possible to provide an image processing program 
recording medium which has recorded a program therein which program, 
when interpolating the image twice number in the horizontal 
direction and the vertical direction, can make uniform the 
appearance probability of error of pixel data, and further, can 
realize the interpolation with a small operation amount and can 
obtain the image with sharpness. 

The image processor according to Claim 10 provides an image 
processor according to Claim 1 in which the pixel selection means 
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is one which selects data A of pixel of interest located at a position 
closest to a pixel for interpolation to be newly generated 
(hereinafter, simply referred to as "new pixel") between pixels of 
low-resolution image having a distance between adjacent pixels being 
"1", data B of upper pixel of low-resolution image adjacent at upper 
side of the pixel of interest, data C of lower pixel of low-resolution 
image adjacent at lower side of the pixel of interest, and the new 
pixel data calculation means is one which calculates data F of the 
new pixel by a formula of F=A+ (j/2) (C-B) on the basis of the data 
A of pixel of interest, data B of upper pixel, data C of lower pixel 
and the distance "j" in the vertical direction from the pixel of 
interest to the new pixel. 

According to the image processor of Claim 10 of the present 
invention having the above-described construction, it is possible 
to provide an image processor which can interpolate an image in the 
vertical direction with less operation amount and which can obtain 
a high-quality image with sharpness. 

The image processing method according to Claim 11 of the 
present invention provides an image processing method according to 
Claim 2 in which the pixel selection process is one which selects 
data A of pixel of interest located at a position closest to a pixel 
for interpolation to be newly generated (hereinafter, simply 
referred to as "new pixel") between pixels of low-resolution image 
having a distance between adjacent pixels being "1", data B of upper 
pixel of low-resolution image adjacent at upper side of the pixel 
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of interest, data C of lower pixel of low-resolution image adjacent 
at lower side of the pixel of interest, and the new pixel data 
calculation process is one which calculates data F of the new pixel 
by a formula of F=A+ ( j/2) (C-B) on the basis of the data A of pixel 
of interest, data B of upper pixel, data C of lower pixel, and the 
distance "j" in the vertical direction from the pixel of interest 
to the new pixel. 

According to the image processing method of Claim 11 of the 
present invention having the above-described construction, it is 
possible to obtain an image processing method which can interpolate 
an image in the vertical direction with a less operation amount and 
which can obtain a high-quality image with sharpness. 

The image processing program recording medium according to 
Claim 12 of the present invention provides an image processing 
program recording medium according to Claim 3 in which the pixel 
selection process is one which selects data A of pixel of interest 
located at a position closest to a pixel for interpolation to be 
newly generated (hereinafter, simply referred to as "new pixel") 
between pixels of low-resolution image having a distance between 
adjacent pixels being "1", data B of upper pixel of low-resolution 
image adjacent at upper side of the pixel of interest, data C of 
lower pixel of low- resolution image adjacent at lower side of the 
pixel of interest, and the new pixel data calculation process is 
one which calculates data F of the new pixel by a formula of F=A+ 
(j/2) (C-B) on the basis of the data A of pixel of interest, data 
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B of upper pixel, data C of lower pixel and the distance "j" in the 
vertical direction from the pixel of interest to the new pixel. 

According to the image processing program recording medium 
of Claim 12 of the present invention having the above-described 
construction, it is possible to obtain an image processing program 
recording medium which having recorded a program therein, which 
program can interpolate an image in the vertical direction with a 
less operation amount and which can obtain a high-quality image with 
sharpness . 

The image processor according to Claim 13 of the present 
invention provides an image processor according to Claim 10 in which 
when generating the high-resolution image having twice number of 
pixels in the vertical direction for the low-resolution image, the 
position of new pixel is made by setting the absolute value of the 
distance "j" in the vertical direction from the pixel of interest 
be 1/4/ and the new pixel data calculation means is one which, when 
calculating data F5 and F6 of new pixel which are adjacent at upper 
and lower of the pixel of interest, respectively, by a formula of 
F=A+( j/2) (C-B) , calculates Y=(j/2) (C-B) previously, and then 
calculates F5=A-X and F6=A+Y. 

According to the image processor of Claim 13 of the present 
invention having the above-described construction, it is possible 
to provide an image processor which can, in interpolating an image 
to twice in the vertical direction, make uniform appearance 
probability of error of pixel data, perform interpolation with a 
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less operation amount and obtain a high-quality image with sharpness . 

The image processing method according to Claim 14 of the 
present invention provides an image processing method according to 
Claim 11 in which, when generating high-resolution image having 
twice number of pixels in the vertical direction for said low- 
resolution image, the position of new pixel is made have the absolute 
value of a distance " j" in the vertical direction from the pixel 
of interest being 1/4, and the new pixel data calculation process 
is one which, when calculating the data F5 and F6 of the new pixel 
located at upper and lower of the pixel of interest, respectively, 
byaformulaof F=A+( j /2 ) (C-B) , previously calculates Y=( j/2) (C-B) , 
and then calculates F5=A-X and F6=A+Y. 

According to the image processing method of Claim 14 of the 
present invention having the above-described construction, it is 
possible to provide an image processing method which, in 
interpolating an image to twice in the vertical direction, can make 
uniform appearance probability of error of pixel data, and can 
perform interpolation with a less operation amount and obtain a 
high-quality image with sharpness. 

The image processing program recording medium according to 
Claim 15 of the present invention provides an image processing 
program according to Claim 12 in which, when generating the 
high-resolution image having twice number of pixels in the vertical 
direction for the low-resolution image, the position of the new pixel 
is made have the absolute value of a distance "j" in the vertical 
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direction from the pixel of interest be 1/4, and the new pixel data 
calculation process is one which, when calculating data F5 and F6 
of the new pixel located at upper and lower of the pixel of 
interest , respectively , by a formula of F=A+( j/2 ) (C-B) , previously 
calculates Y=(j/2)(C-B) and then calculates F5=A-X and F6=A+Y. 

According to the image processing program recording medium 
of Claim 15 of the present invention having the above-described 
construction, it is possible to provide an image processing program 
recording medium which, in interpolating an image to twice in the 
vertical direction, can make uniform appearance probability of error 
of pixel data, and can perform interpolation with a less operation 
amount and obtain a high-quality image with sharpness. 

BRIEF DESCRIPTION OF DRAWINGS 

Figure 1 is a flow chart showing an operation procedure of 
a calculation procedure of performing resolution conversion of S 
xT pixel image to X x Y pixel image in the image processor according 
to the first embodiment of the present invention. 

Figure 2 is a diagram illustrating the position of new pixel 
which is interpolated by the image processor according to the first 
embodiment of the present invention. 

Figure 3 is a diagram showing the position of new pixel in 
a case where 700 pieces of original pixels in 1 line are interpolated 
by 1000 new pixels. 

Figure 4 is a diagram illustrating the interpolation position 
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of pixels according to the conventional linear interpolation. 

Figure 5 is a diagram illustrating the intensity of new pixel 
which is interpolated by the image processor according to the first 
embodiment of the present invention. 

Figure 6 is a diagram illustrating the pixel arrangement when 
the conventional image processing method performs resolution 
conversion to twice number of pixels in the horizontal and vertical 
directions, respectively. 

Figure 7 is a diagram illustrating the position of new pixel 
interpolated by the image processor according to the second 
embodiment of the present invention. 

Figure 8 is a flow chart showing a calculation procedure for 
performing resolution conversion from an image of horizontal 32 0 
x vertical 240 pixels to horizontal 640 x vertical 480 pixels with 
interpolating to twice number of pixels in the horizontal and 
vertical directions, respectively, in the image processor according 
to the second embodiment of the present invention. 

Figure 9 is a diagram illustrating the position of new pixel 
which is interpolated by the image processor according to the third 
embodiment of the present invention. 

Figure 10 is a flow chart showing an operation procedure for 
performing resolution conversion from horizontal 320 x vertical 240 
pixels to horizontal 320 x vertical 480 pixels with interpolating 
to twice number of pixels in the vertical direction in the image 
processor according to the third embodiment of the present invention. 
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Figure 11 is a block diagram showing the construction of the 
image processor according to the first embodiment of the present 
invention . 

Figure 12 is a block diagram showing the construction of the 
image processor according to the second embodiment of the present 
invention. 

Figure 13 is a block diagram showing the construction of the 
image processor according to the third embodiment of the present 
invention. 

Figure 14 is a diagram showing an example of a situation where 
the image processor as a target of the present invention is employed. 



BEST MODE FOR CARRYING OUT THE INVENTION 

Hereinafter, the present embodiment will be described with 
referring to figures. The embodiment shown here is just an example 
and the present invention is not limited to the embodiment. 
(Embodiment 1) 

The image processor according to the first embodiment of the 
present invention is one in which conversion of low-resolution image 
into high-resolution image is carried out by performing 
interpolating by a simple configuration. 

That is, a pixel of original image that is closet to the 
position of new pixel for interpolation is taken as a pixel of 
interest, the difference between adjacent pixel data which is a pixel 
of original image are adjacent to each other putting between the 
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pixel of interest is obtained, and the result of multiplication of 
the ratio between the distance between the pixel of interest and 
the new pixel and the distance between the adjacent pixels and the 
difference is added to the pixel data of the pixel of interest, 
thereby generating the pixel data of the new pixel. 

Figure 2 is a diagram illustrating the position of new pixel 
which is interpolated by the image processor according to the first 
embodiment of the present invention. 

In figure 2, numerals 201 through 209 are original pixels 
adjacent to each other in the horizontal or vertical direction with 
a pixel interval of " 1" . Numeral 210 denotes a new pixel which is 
generated by interpolating low-resolution image, whose intensity 
is represented by F. Numeral 205 denotes , a pixel of interest which 
is the closest to new pixel 210, which has intensity A. Numerals 
202, 208, 204 and 206 denote upper pixel, lower pixel, left pixel, 
respectively, which are adjacent the pixel of interest 205, and are 
situated at upper side, lower side, left-hand side, and right-hand 
side, respectively, with relative to the pixel of interest 205, and 
which are adjacent the pixel of interest 205 and have intensity B, 
C, D and E, respectively. Further, "i" denotes the distance between 
pixel of interest 205 and new pixel 210 in the horizontal direction, 
and "j M presents the distance between pixel of interest 205 and new 
pixel 210 in the vertical direction, and right hand direction and 
downward direction are assumed to be positive. 

The intensity F of new pixel 210 is calculated by the formula 
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of 



F=A+(i/2) <E-D)+(j/2) (C-B) . 



Because the interpolation point is previously known in this 
formula, (i/2) and (j/2) can be provided as constants beforehand, 
and therefore, the number of times of operation required for 
calculating the intensity F requires twice of multiplication and 
four times of addition or subtraction for calculating the intensity 
F. On the contrary, the conventional linear interpolation requires 
six times of multiplication and five times of addition or subtraction 
for calculating the intensity of new pixel, thereby the image 
processor according to the first embodiment of the present invention 
requires less calculation amount than the conventional linear 
interpolation. 

Next, intensity F of new pixel 210 will be briefly described 
with taking the horizontal direction of figure 2 as an example. 

Figure 5 is a diagram illustrating the intensity of new pixel 
which is interpolated by the image processor according to the first 
embodiment of the present invention. 

Here, a simple assumption is taken for interpolating. 
Hereinafter, the assumption will be described with referring to 
figure 5- Figure 5 is a diagram illustrating an image interpolation 
model- For simplification, the image is represented in one- 
dimension and broadening of an image is presented in the horizontal 
direction while intensity of image is presented in the vertical 
direction. 
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In figure 5, the ordinate presents a intensity and the 
abscissas presents the distance in the horizontal direction in 
figure 2. Numerals 2 04, 205, 206, 210 and i denote the same elements 
as shown in figure 2. Numeral 501 denotes a intensity curved line 
(actually, intensity curved plane) of low-resolution image, 502 
denotes a line presenting positions which are apart only by the 
distance M i" from a pixel of interest 205, 503 denotes a line 
connecting an original pixel 204 and an original pixel 206, 504 
denotes a line which is parallel with line 506 and connects a pixel 
of interest 2 05 and a new pixel 210, 5 05 denotes the pixel interval 
of low- resolution image, 506 denotes a line connecting a pixel of 
interest 205 and an original pixel 206, 507 denotes a crossing point 
of line 502 and line 506, which is a new pixel interpolated by the 
conventional linear interpolation. Further, numeral 509 denotes the 
distance between original pixel 204 and original pixel 206.. 

In order to clarify the difference with the conventional 

linear interpolation, the intensity D, A and E of original pixels 

204, 205 and 20 6 are assumed to be D<E<A. 

When numeral 501 denotes an original intensity curved line 

of image, it is assumed that original image pixels are sampled at 

even intervals in the horizontal direction such as 204, 205 and 206. 

At this time, the interpolation data at the interpolated points on 

a straight line 502 are assumed to be obtained. 

As a reference, in a case where linear interpolation is 

performed, the crossing point of straight line 506 connecting pixel 
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205 and pixel 2 06 and straight line 502 becomes an interpolation 
data- In contrast thereto, the intersection point of a tangent of 
intensity curved line at the position of pixel 205 and straight line 
502 is assumed to be an interpolation data in first embodiment of 
the present invention. Further f approximately, the gradient of a 
tangent at pixel 205 is assured to be equal to the gradient of straight 
line 503 connecting pixel 204 and pixel 2 06. According to this 
assumption, the straight line 504 having the same inclination as 
the straight line 503, and which passes through the pixel 205 can 
be obtained, and further, new pixel 210 as interpolated data can 
be obtained at the crossing point of the straight line 504 and the 
straight line 5 02. 

By assuming as ; above, the process is actually performed such 
that the intensity of the pixel 204 is subtracted from that of the 
pixel 206, the result is multiplied by a ratio between the distance 
"i" and the distance 509, and the result is added to the intensity 
of pixel 205, thereby it becomes possible to obtain an interpolation 
result by quite an easy processing. 

In order to produce an actual formula, when the intensity of 
pixel 204 is assumed to be "D", the intensity of pixel 205 be "A", 
the intensity of pixel 206 be "E" , the distance 509 be "2 M (-twice 
as the interval of abutted pixels "1") and the distance 510 be "i", 
the intensity F of the pixel 210 is given by 
F=A+(i/2)(E-D), 

which is quite a simple formula requiring only one time 
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multiplication and two times addition or subtraction. 

As shown in figure 5, while the intensity of new pixel 507 
which is interpolated by the conventional linear interpolation 
amounts to the average of intensity A and E , the image processor 
according to the first embodiment can obtain high-quality image with 
sharpness since the intensity of new pixel 210 which is interpolated 
by the image processor is not limited to between the intensity A 
and F . 

Figure 11 is a block diagram showing the construction of the 
image processor according to the first embodiment. 

In figure 11, numeral 1131 denotes a line memory means which 
is configured as follows. 

To be specific, numeral 1101 denotes a lower line memory which 
receives as its input low-resolution image sequentially from an 
original pixel data at upper end of frame, 1102 denotes a middle 
line memory which receives as its input the output of lower line 
memory 1101, 1103 denotes an upper line memory which receives as 
its input the output of middle line memory 1102, each line memory 
has a storage capacity for storing the original pixels of low- 
resolution image up to 1 line in the horizontal direction, and it 
outputs the oldest data of 1 pixel among stored data if one pixel 
data is input when the memory storage is filled. Further, 1105 
denotes an upper end processing path for copying instantaneously 
the data which is stored in the middle line memory 1102 to the upper 
line memory 1103 at the frame upper end processing, and 1104 denotes 
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a lower end processing path for instantaneously copying the data 
which is stored in the middle line memory 1102 to the lower line 
memory 1101 at the flame lower end processing. 

Further, numeral 1132 denotes a data buffer means that is 
configured as follows. 

To be specific, numeral 1107 denotes aright pixel data buffer, 
1108 denotes a pixel of interest data buffer, 1109 denotes a left 
pixel data buffer, 1110 denotes a lower right pixel data buffer, 
1111 denotes a lower pixel data buffer, 1112 denotes an upper right 
pixel data buffer and 1113 denotes an upper pixel data buffer, each 
data buffer is a storage capacity for storing a data of 1 pixel 
temporarily, and output the data which is stored beforehand when 
the data of 1 pixel is input. Further, numeral 1106 denotes a left 
end processing path for copying instantaneously the data which is 
stored in the pixel of interest data buffer 1108 to the left pixel 
data buffer 1109 at a flame left end processing. 

Further, numeral 1130 denotes a pixel selection means that 
is constructed by a line memory means 1131 and a data buffer means 
1132. 

Further, numeral 1133 denotes a new pixel data arithmetic 
means for obtaining the data of new pixel that is constructed as 
follows. 

To be specific, numeral 1114 denotes a horizontal subtracter 
for obtaining the difference in the hori2ontal direction, 1115 
denotes a vertical subtracter for obtaining the difference in the 
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vertical direction, 1116 denotes a horizontal arithmetic device for 
obtaining the correction value in the horizontal direction, 1117 
denotes a vertical calculator for obtaining the correction value 
in the vertical direction, 1134 denotes a new pixel data calculator 
for obtaining the data of new pixel. 

Hereinafter, the distance from pixel of interest to new pixel 
will be described by one dimension for simplification. 

Figure 3 is a diagram illustrating the position of new pixel 
in a case where 7 00 pieces of original pixels one line are 
interpolated by 1000 pieces of new pixels. 

In figure 3, numeral 301 denotes an axis representing 
horizontal direction of the flame, and pO, pi, p2 and p3 denote 
original pixels which represent the positions on the axis 301 by 
employing an arrow, respectively, and assumes the pixel interval 
be "1". The qO, ql , q2 and q3 denote new pixels which represent the 
positions on the axis 301 employing an arrow, respectively, each 
figure in parenthesis is pixel position which is represented by the 
distance from the original pixel p0- 

Numeral 302 denotes the position of new pixel which is 
represented by a form dividing the distance from the original pixel 
p0 into an integral part and a decimal part, and the integral part 
presents the position of a pixel of interest against new pixel and 
the decimal part presents the distance from a pixel of interest to 
new pixel in such a manner that the absolute value of decimal part 
does not exceed a threshold of 0.5. For instance, new pixel q3 has 
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a distance from the original pixel po being 2.1, and dividing the 
same into integral part and decimal part not exceeding 0.5, results 
in 2+0.1, which means the pixel of interest against new pixel q3 
is the original pixel p2, and the distance from the original pixel 
p2 to new pixel q3 is 0.1. Further, new pixel ql has a distance from 
the original pixel pO being 0.7, and dividing the same into integral 
part and decimal part not exceeding 0,5, results in 1-0.3, which 
means the pixel of interest against new pixel ql is the original 
pixel pi and the distance from the original pixel pi to new pixel 
ql is -0.3. 

Numeral 3 03 denotes the position of new pixel, which is 
presented by scaling the decimal part of the position 302 into 1/2. 
In the actual interpolation calculation, the distance "i" and "j" 
from pixel of interest to new pixel is scaled into 1/2 to be employed 
for the calculation, the decimal part is scaled into 1/2 beforehand, 
and the integral part and the decimal part are divided with the 
absolute value of the decimal part not exceeding threshold of 0.25. 
Further, the threshold value is obtained by multiplying 0.5 on the 

size of scaling. 

Hereinafter, the operation of line memory means 1131 and data 
buffer means 1132 will be described. 

Firstly, the basic operation will be described. This is a case 
where flame end processing (described later) is not related. 

When it has no relation to flame end processing, the line 
memory means 1131 and the data buffer means 1132 stores data of each 
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full storage capacity • 

Here, the lower line memory 1101 receives as its input data 
of 1 pixel from the outside and output the oldest data of 1 pixel 
among stored data to the middle line memory 1102 and the lower right 
pixel data buffer 1110. Further, the middle line memory 1102 
receives as its input the data of 1 pixel from the lower line memory 
1101 and output the oldest data of 1 pixel among stored data to the 
upper line memory 1103 and the right pixel data buffer 1107. Further, 
the upper line memory 110 3 receives as its input the data of 1 pixel 
from the middle line memory 1102 and output the oldest data of 1 
pixel among stored data to the upper right pixel data buffer 1112. 

Further, the lower right pixel data buffer 1110 receives as 
its input the data of 1 pixel from the lower line memory 1101 and 
output the data of 1 pixel to the lower pixel data buffer 1111. 
Further, the lower pixel data buffer 1111 receives as its input the 
data of 1 pixel from the lower right pixel data buffer 1110 and output 
the data of 1 pixel to the vertical subtracter 1115. 

Further, the right pixel data buffer 1107 receives as its input 
the data of 1 pixel from the middle line memory 1102 and output the 
data of 1 pixel to the pixel of interest data buffer 1108 and the 
horizontal subtracter 1114. Further, the pixel of interest data 
buffer 1108 receives as its input the data of 1 pixel from the riyht 
pixel data buffer 1107 and output the data of 1 pixel to the left 
pixel data buffer 1109 and new pixel data calculator 1134. The left 
pixel data buffer 1109 receives as its input the data of 1 pixel 
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from the pixel of interest data buffer 1108 and output the data of 
1 pixel to the horizontal subtracter 1114. 

Further, the upper right pixel data buffer 1112 receives as 
its input the data of 1 pixel from the upper line memory 1103 and 
output the data of 1 pixel to the upper pixel data buffer 1113, The 
upper pixel data buffer 1113 receives as its input the data of 1 
pixel from the upper right pixel data buffer 1112 and output the 
data of 1 pixel to the vertical subtracter 1115. 

Accordingly, if the data of pixel can be obtained by scanning 
1 line from left-hand side toward right-hand side of the image and 
each line sequentially from the upper side toward the lower side 
of the image, the highest line among three lines could be stored 
in the upper line memory 1103 in which a line data which is first 
input is stored among three line memories 1 101 , 1102 and 1103, the 
highest line among three lines is stored among three lines is stored. 
In addition, in the upper right pixel data buffer 1112 in which the 
pixel data which is first input is stored among two data buffer 1112 
and 1113, the pixel data which is positioned at the left-side among 
two pixel data is stored. 

Accordingly, in the data buffer 1107 or 1113 in the data buffer 
means 1132 in figure 11, a right pixel, a pixel of interest, a left 
pixel, a right lower pixel, a lower pixel, an upper right pixel and 
an upper pixel are stored with locating the pixel of interest data 
buffer 1108 at their center. Thereby, the storing of pixel 
arrangement shown in figure 2 is realized. 
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Hereinafter, four flame end processing will be described. 
Firstly, the operation of flame upper end processing will be 
described . 

Since there is no pixel which is adjacent the pixel of interest 
at the upper side thereof in a case where a pixel of interest is 
a pixel of flame upper end, the flame upper end processing performs 
pixel interpolation with copying the data of pixel of interest 
thereto. Further, the flame upper end processing performs, when the 
lower line memory 1101 receives the vertical synchronous signal 
indicating the beginning of a flame, the following operation. 

When the data of pixel on the second line is input after storing 
all pixel data of the first one line, the lower line memory 1101 
outputs stored pixel data of the first one to the middle line memory 
1102 without outputting to the right pixel data buffer 1110. Then, 
the lower line memory 1101 stores all pixel data of the second line, 
and the middle line memory 1102 stores all pixel data of the first 
line. 

Then, the upper end processing path 1105 copies all pixel data 
of the second line which are stored in the middle line memory 1102 
to the upper line memory 1103. The upper line memory 1103 stores 
all pixel data of the first line, and thereafter, the line memory 
means 1131 performs a basic operation. 

Secondly, a flame lower end processing will be described. 

Since there is no pixel which is adjacent the pixel of interest 
at the lower side thereof in a case where the pixel of interest is 
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a pixel of a flame lower end, the flame lower end processing performs 
pixel interpolation with copying the data of pixel of interest 
thereto. Further, the frame lower end processing performs, when the 
lower line memory 1101 receives a vertical synchronous signal 
indicating the end of flame. 

The lower line memory 1101 which receives as its input the 
data of pixel of the last line output stored data of pixel of the 
last line one by one pixel during the vertical synchronous signal. 
Thereafter, the data which is stored in the lower line memory 1101 
is lost, and the middle line memory 1102 stores all pixel data of 
the last line. 

The lower end processing path 1104 copies the pixel data of 
the last line which is stored in the middle line memory 1102 to the 
lower line memory 1101. Then, the lower line memory 1101 stores the 
pixel data of the last line, and thereafter, the line memory means 
1131 performs a basic operation. 

Thirdly, a flame left end processing will be described . 

The flame left end processing performs, when the pixel of 
interest is a pixel of flame left end which has no pixel adjacent 
the pixel of interest at left side thereof, pixel interpolation with 
copying the data of pixel of interest thereto. Further, the front 
left end processing performs, when the pixel of interest data buffer 
1108 receives a horizontal synchronous signal indicating the 
beginning of the line, the following operation. 

The pixel of interest data buffer 1108 which received a 
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horizontal synchronous signal indicating the beginning of the line 
stores the data of the first pixel. Next, the left end processing 
path 1106 copies the data of first pixel which is stored in the pixel 
of interest data buffer 1108 to the left pixel data buffer 1109. 
Then, the left pixel data buffer 1109 stores the first pixel data 
of each line, and thereafter, the data buffer means 1132 performs 

a basic operation. 

Fourthly, a flame right end processing will be described. 
The flame right end processing performs, when the pixel of 
interest is a pixel of flame right end which has no pixel adjacent 
the pixel of interest at right side thereof, pixel interpolation 
with copying the data of pixel of interest thereto. Further, the 
flame end processing, performs, when the lower line memory 1101 
receives a horizontal synchronous signal indicating the end of the 
line, the following operation. 

Due to that the line memory means 1131 would not shift data 
during the horizontal synchronous signal indicating the end of the 
line, the data would not be shifted from the line memory means 1131 
to the data buffer means 1132. 

Here, the right pixel data buffer 1107 copies the stored pixel 
data of the line end to the pixel of interest data buffer 1108, and 
the lower right pixel data buffer 1110 and the upper right pixel 
data buffer 1112 output stored pixel data of the line end to the 
lower pixel data buffer 1111 and the upper pixel data buffer 1113, 
respectively. Both the right pixel data buffer 1107 and the pixel 
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of interest data buffer 1108 can store the data of the pixel of 
interest at the right end of the flame, and the left pixel data buffer 
1109 can store the pixel data which is adjacent the pixel of interest 
at left side thereof, and the upper pixel data buffer 1113 and the 
lower pixel data buffer 1111 can store the pixel data which is 
adjacent the pixel of interest at the upper and the lower side thereof, 
respectively, and thereafter, the line memory means 1131 and the 
data buffer means 1132 performs basic operations. 

According to these four flame end processing, even when a pixel 
of interest is situated at the end part of flame which does not have 
an adjacent pixel at any side of the pixel of interest, the adjacent 
pixel value could be filled with the value of pixel of interest, 
thereby resulting in capability of calculating new pixel data. 

In this way, the line memory means 1131 and the data buffer 
means 1132 can store the data of pixel of interest into the pixel 
of interest data buffer 1108 and store the data of pixels which are 
adjacent to the upper, the lower, the left side, and the right side 
of the target pixel into the upper pixel data buffer 1113, the lower 
pixel data buffer 1111, the left pixel data buffer 1109 and the right 
pixel data buffer 1107, respectively, by basic operations for 
shifting the data of pixel which is input from the outside one by 
one, and four flame end processing. 

Next, an operation of the arithmetic means 1133 will be 
described . 

The horizontal subtracter 1114 receives as its input the right 
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pixel data from the right pixel data buffer 1107 and the left pixel 
data from the left pixel data buffer 1109, and subtracts the left 
pixel data from the right pixel data, and output the difference in 
the horizontal direction to the horizontal arithmetic device 1116. 
The horizontal arithmetic device 1116 multiples (coefficient 1/2), 
(the distance in horizontal direction from pixel of interest to new 
pixel) and (the difference in horizontal direction), and outputs 
the horizontal correction value to new pixel data calculator 1134. 
The vertical subtracter 1115 receives as its inputs the lower pixel 
data from the lower pixel data buffer 1111 and the upper pixel data 
from the upper pixel data buffer 1113, and subtracts the upper pixel 
data from the lower pixel data, and output the difference in vertical 
direction to the vertical arithmetic device 1117, The vertical 
arithmetic device 1117 multiples (coefficient 1/2), (the distance 
in vertical direction from pixel of interest to new pixel) and. (the 
difference in vertical direction) , and outputs the vertical 
correction value to new pixel data calculator 1134. The new pixel 
data calculator 113 4 receives as its input the data of pixel of 
interest from the pixel of interest data buffer 1108, and adds (the 
data of pixel of interest), (horizontal correction value ) and 
(vertical correction value), and output the new pixel data. 

Next, an operation procedure of the operation means 1133 will 
be described with referring to figure 1 . 

Figure 1 is a flow chart showing an operation procedure for 
performing resolution conversion of an image of S * T pixels to that 
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of X x Y pixels . 

In figure 1, S denotes a pixel number of low-resolution image 
in the horizontal direction, T denotes a pixel number of low- 
resolution image in the vertical direction, X denotes a pixel number 
of high-resolution image in the horizontal direction, Y denotes a 
pixel number of high-resolution image in the vertical direction, 
px denotes a horizontal pitch, py denotes a vertical pitch, yy denotes 
a position of pixel of interest in the vertical direction, b denotes 
a vertical coefficient, 1 denotes a vertical loop counter, xx denotes 
a position of pixel of interest in the horizontal direction, a denotes 
a horizontal coefficient, k denotes a horizontal loop counter, 
Q[k,l] denotes a intensity at the position of new pixel t^,l], 
P[xx,yy] denotes a intensity at the position of original pixel 
[xx^y], and there are relations of 0<S<X, 0<T<Y,0<k<X, 0<KY,0<xx<S, 
and 0<yy<T . 

5101 denotes a pitch-calculating step for calculating the 
pitch of new pixel in each of the horizontal and vertical directions . 
The horizontal pitch px is calculated by S/X/2, and the vertical 
pitch py is calculated by T/Y/2. 

5102 denotes a vertical loop default setting up step for 
setting initial values for variables concerning the vertical loop, 
and it assigns the initial value "0- to the position yy in vertical 
direction of the pixel of interest, the vertical coefficient b, and 
the vertical loop counter 1, respectively. 

51 03 denotes a horizontal loop default setting up step for 
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setting initial values for variables concerning the horizontal loop, 
and it assigns the initial value "0" to the position xx in horizontal 
direction of pixel of interest, the horizontal coefficient a, and 
the horizontal loop counter k, respectively. 

5104 denotes a intensity calculating step for calculating the 
intensity of new pixel and the intensity of new pixel Q [k.,1] is 
calculated by 

Q[k,l] = P[xx,yy]+a(P[xx+l,yy]-P[xx-l,yy] ) 
+b(P[xx,yy+l]-P[xx,yy-l] ) . 

5105 denotes a horizontal coefficient calculating step for 
calculating new horizontal coefficient, and it is calculated by 
adding the horizontal pitch px to the horizontal coefficient a. 

5106 denotes a horizontal coefficient threshold comparison 
step for comparing the horizontal coefficient with threshold value 
0.25, and, in accordance with the comparison result, it proceeds 
to step S108 when the horizontal coefficient a is smaller than or 
equal to the threshold value, while it proceeds to step SI 07 when 
it is larger than the threshold value. 

5107 denotes a pixel of interest right shifting step for 
shifting the pixel of interest toward right direction, and the 
position of pixel of interest in the horizontal direction is shifted 
by xx=xx+l, and the horizontal coefficient is shifted by a=a-0.5. 

5108 denotes a horizontal loop conclusion judging step for 
judging the conclusion of horizontal loop which is repeated from 
step S104 through S108, and it compares new horizontal loop counter 
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k. which is obtained by adding 1 to the pixel number X in horizontal 
direction of high-resolution image, and f in accordance with the 
comparison result, it proceeds to step S104 when new horizontal loop 
counter k. is smaller than X, while it proceeds to step S109 when 
it is equal to X. 

5109 denotes a vertical coefficient-calculating step for 
calculating new vertical coefficient, and it is calculated by adding 
the vertical pitch py to the vertical coefficient b. 

5110 denotes a vertical coefficient threshold comparison step 
for comparing the vertical coefficient with threshold value 0.25, 
and, in accordance with the comparison result, it proceeds to step 
S112 when the vertical coefficient b is smaller than or equal to 
the threshold value, while it proceeds to step Sill when it is larger 
than the threshold value. 

5111 denotes a pixel of interest downward shifting step for 
shifting the pixel of interest in downward direction, and the 
position of pixel of interest in the vertical direction is shifted 
by yy=yy+l, and the vertical coefficient is shifted by b=b-0.5. 

5112 denotes a vertical loop conclusion judging step for 
judging the conclusion of vertical loop which is repeated from step 
SI 03 through SI 12, and it compares new vertical loop counter 1, which 
is obtained by adding "1" to the vertical loop counter 1, with the 
pixel number Y in vertical direction of high-resolution image, and, 
in accordance with the comparison result, it proceeds to step SI 03 
when new vertical loop counter 1 is smaller than Y, while it 
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-terminates pixel interpolation of an image when it is equal to Y. 

In the image processor according to the first embodiment of 
the invention, the image processor for converting low-resolution 
image to high-resolution image with interpolating the low- 
resolution image includes a pixel selection means 1130 for 
extracting a pixel of interest, an upper pixel, a lower pixel, a 
left pixel and a right pixel, the vertical subtracter 1115 for 
calculating the difference in vertical direction on the basis of 
the upper and lower pixel data, the horizontal subtracter 1114 for 
calculating the difference in horizontal direction on the basis of 
the left and right pixel data, the vertical arithmetic device 1117 
for calculating the vertical correction value on the basis of the 
difference in vertical direction and the distance from a pixel of 
interest to new pixel in vertical direction, the horizontal 
arithmetic device 1116 for calculating the horizontal correction 
value on the basis of the difference in horizontal direction, and 
the distance from a pixel of interest to new pixel in vertical 
direction, and the new pixel data calculator 1134 for calculating 
the new pixel data on the basis of data of pixel of interest, the 
vertical correction value, and the horizontal correction value, and 
further, the intensity F is calculated by F=A+(i/2) (E-D) + ( j/2) (C-B) 
on the basis of intensity A of pixel of interest, the intensity B 
of upper pixel, the intensity C of lower pixel, the intensity D of 
left pixel, the intensity E of right pixel and the position (i, j) 
of new pixel. Thereby, it is possible to reduce an operation amount 
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for interpolating images and to mprove the processing speed, and 
further, a high-quality image with sharpness is obtained without 
smoothing an edge part of image. 
(Embodiment 2 ) 

The image processor according to a second embodiment is one 
which converts a low-resolution image of horizontal 320 x vertical 
240 pixels to a high-resolution image of horizontal 640 Xvertical 
480 pixels with interpolating to twice number of pixels in each of 
the horizontal and vertical directions, and one which is limited 
to interpolation to twice number in vertical and horizontal 
directions which are well employed in resolution conversion 
processing so as to suppress arithmetic operation amount to the 
minimum. 

Figure 12 is a block diagram showing the construction of the 
image processor according to the second embodiment. 

In figure 12, like reference characters as figure 11 designate 
the same parts, 1233 denotes new pixel data arithmetic means and 
is constructed as follows. 

To be specific, 1114 and 1115 denotes the same elements as 
those in figure 11, 1216 denotes a horizontal arithmetic device for 
obtaining the horizontal correction value by shifting the difference 
in the horizontal direction leftward by 3 bit so as to make the same 
to 1/8, 1217 denotes a vertical arithmetic device for obtaining the 
vertical correction value by shifting the difference in the vertical 
direction by 3 bit so as to make to 1/8, 1218 denotes an upper left 
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new pixel data calculator for calculating the data of new pixel for 
interpolation at upper left of pixel of interest, 1219 denotes an 
upper right new pixel data calculator for calculating the data of 
new pixel for interpolation at upper right of pixel of interest, 
1220 denotes a lower left new pixel data calculator for calculating 
the data of new pixel for interpolation at lower left of pixel of 
interest, 1221 denotes a lower right new pixel data calculator for 
calculating the data of new pixel for interpolation at lower right 
of pixel of interest. Further, 123 5 denotes new pixel data 
calculator which is constructed by the upper left new pixel data 
calculator 1218, the upper right new pixel data calculator 1219, 
the lower left new pixel data calculator 1220, and the lower right 
new pixel data calculator 1221, 

Further, 1234 is a maintenance means, and is constructed as 
follows. 

1222 denotes an upper new pixel line memory for storing the 
data of new pixel which is situated at the upper of pixel of interest 
by 1 line of high-resolution image, 1223 denotes a lower new pixel 
line memory for storing the data of new pixel which is situated at 
the lower of pixel of interest by 1 line of high-resolution image. 

Figure 7 is a diagram illustrating the position of new pixel 
which is interpolated by the image processor according to the 
embodiment of the present invention. 

In figure 7, "O" denotes an original pixel of low-resolution 
image having a pixel interval of -1", W D M denotes a new pixel of 
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high-resolution image. Further, new pixels do not match with the 
position of original pixel, but are positioned at points which are 
distant from the original pixels by the distances the absolute values 
of which are 1/4 in both the horizontal and vertical directions. 
The intensity of the original pixels of 701,702,703,704 and 705 and 
the new pixels of 706,707,708,709 are designated as P701, P702, P703, 
P704, P705, Q706, Q707, Q708 and Q709, respectively. 

According to this pixel arrangement, since all the new pixels 
are arranged at equal intervals from the original pixels, the 
appearance probability of the error of pixel data becomes uniform. 
However, in this arrangement, the operation amount will increase 
because it is necessary to create all of new pixels. In this second 
embodiment, utilizing the nature that the distances from the 
original pixel are all equal, the calculation amount can be 
suppressed. 

To be specific, if difx = ( 1/8 ) (P705-P704 ) , difx = 
< 1/8) (P703-P702 ) are first calculated on the basis of original 
pixels 701,' 702, 703, 704 and 705, the arithmetic expression for 
calculating the intensity of new pixels Q706, Q707, Q708, Q709, 
becomes as follows, 

Q7 0 6=P7 0 1 -di f x-dif y 

Q7 07=P7 01+difx-dify 

Q7 0 8=P 7 0 1 -di f x+di f y 

Q7 09=P7 01+dif x+dify 
and, number of times required for obtaining the intensity Q7 0 6 
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through Q7 09 of four new pixels from the intensity P7 01 of one pixel 
of interest are only ten times addition or subtraction and two times 
division - 

In addition, if the calculation of P701-difx and P701+difx 
are shared, the intensity of four new pixels can be obtained by eight 
times addition and subtraction and two times division. 

Next, the operation will be described. 

The horizontal subtracter 1114 receives as its inputs the data 
of right pixel from the right pixel data buffer 1107 and the data 
of left pixel from the left pixel data buffer 1109/ and subtracts 
the data of left pixel from the data of right pixel, and output the 
difference in the horizontal direction to the horizontal arithmetic 
device 1216. The horizontal arithmetic device 1216 shifts the 
difference in the horizontal direction toward leftward to 1/8 and 
outputs the horizontal correction value to the uppex- left new pixel 
data calculator 1218, the upper right new pixel data calculator 1219, 
the lower left new pixel data calculator 1220 f and the upper right 
new pixel data calculator 1221. Further, the vertical subtracter 
1115 receives as its inputs the data of lower pixel from the lower 
pixel data buffer 1111 and input the data of upper pixel from the 
upper pixel data buffer 1113, and subtracts the data of upper pixel 
from the data of lower pixel, and output the difference in the 
vertical direction to the vertical arithmetic device 1217. The 
vertical arithmetic device 1217 shifts the difference in the 
vertical direction toward leftward to 1/8 and outputs the vertical 
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correction value to the upper left new pixel data calculator 1218, 
the upper right new pixel data calculator 1219, the lower left new 
pixel data calculator 1220 and the upper right new pixel data 
calculator 1221. 

The upper left new pixel data calculator 1218 receives as its 
input the vertical correction value from the vertical arithmetic 
device 1217, the horizontal correction value from the horizontal 
arithmetic device 1216, and the data or pixel of interest from the 
pixel of interest data buffer 1108, respectively, and then subtracts 
the vertical correction value and the horizontal correction value 
from the data of pixel of interest and output the data of new pixel 
to be interpolated to the upper new pixel line memory 1222 . The upper 
right new pixel data calculator 1219 subtracts the vertical 
correction value from the data of pixel of interest and adds the 
horizontal correction value, and output the data of new pixel to 
be interpolated to the upper new pixel line memory 1222. The lower 
left new pixel data calculator 1220 adds the vertical correction 
value to the data of pixel of interest and subtracts the horizontal 
correction value, and output the data of new pixel to be interpolated 
to the lower new pixel line memory 1223, The lower right new pixel 
data calculator 1221 adds the vertical correction value to the data 
of pixel of interest and adds the horizontal correction value, and 
output the data of new pixel to be interpolated to the lower next 
pixel line memory 1223. 

The upper new pixel line memory 1222 receives as its input 
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the data from the upper left new pixel data calculator 1218 and 
subsequently the data from the upper right new pixel data calculator 
1219 by 1 pixel alternately, and stores the data of new pixel to 
be interpolated at upper of pixel of interest for 1 line of the 
high-resolution image, and output all of 1 line in the order of 
storing- The lower new pixel line memory 1223 receives as its input 
the data from the lower left new pixel data calculator 1220 and 
subsequently the data from the lower right new pixel data calculator 
1221 by 1 pixel alternately, and stores the data of new pixel to 
be interpolated at the lower of pixel of interest for 1 line of 
high-resolution image, and output all of 1 line in the order of 
storing, after the upper new pixel line memory 12 22 output the data 
of 1 line. 

Next, a calculation procedure of the arithmetic means 123 3 
will be described with referring to figure 8. 

Figure 8 is a flow chart showing a calculation procedure fox- 
performing resolution conversion from horizontal 32 00x vertical 240 
pixels to horizontal 64 0 x vertical 480 pixels with interpolating 
to twice number of pixels in both of the horizontal and vertical 
directions in the image processor according to the second embodiment 
of the present invention. 

In figure 8, difx is horizontal correction value, dify is 
vertical correction value, and k, 1, Q, P are the same as those in 
figure 1, and there are relations of 0<k<320, 0<1<240. 

S801 denotes a vertical loop default initial setting up step 
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for setting an initial value to a variable related to a vertical 
loop, which assigns initial value 0 to the vertical loop counter 
1. 

5802 denotes a horizontal loop default initial setting up step 
for setting an initial value to a variable related to a horizontal 
loop, which assigns initial value 0 to the horizontal loop counter 
k. 

5803 denotes a correction value calculating step for 
calculating a correction value in both the horizontal and vertical 
direction, which obtains the horizontal correction value difx and 
the vertical correction value dify by calculating difx =(P [k+l,l]-P 
[k-l,l]/8, dify=<P[k, 1+1 ]-P [ k, 1-1 ] ) /8 , respectively. 

5804 denotes a intensity calculating step for calculating the 
intensity of four new pixels, and the intensity of new pixel for 
interpolation to the upper left of pixel of interest Q[2k,21], the 
intensity of new pixel for interpolation to the upper right of pixel 
of interest Q[ 2k+l , 21 ] , the intensity of new pixel for interpolation 
to the lower left of pixel of interest Q[ 2k, 21+1] , and the intensity 
of new pixel for interpolation at lower right of pixel of interest 
Q(2k+1 ,21] by calculating Q[ 2k, 21 ] =P [ k, 1 ] -dif x-dlf y , 
Q[2k+l,21]=P[k,l]+difx-dify, Q[ 2k, 21+1 ]=P[k, 1 ] -dif x+dify , 
Q[ 2k+l , 21+1 ]=P[k, l]+dif x+dify respectively. 

5805 denotes a horizontal loop conclusion judging step for 
judging the conclusion of horizontal loop which comprises repeating 
step S803 through S805, which compares new horizontal loop counter 
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k which is obtained by adding 1 to the horizontal loop counter k 
with the number of pixels 320 in the horizontal direction of 
low-resolution image, and according to the result, it proceeds to 
step S 803 in when new horizontal loop counter k is smaller than 
320 while it proceeds to step S806 when it is equal to 320. 

S806 denotes a vertical loop conclusion judging step for 
judging the conclusion of vertical loop which comprises repeating 
step S8 02 through S806, which compares new vertical loop counter 
1 which is obtained by adding 1 to the vertical loop counter 1 with 
the number of pixels 24 0 in the vertical direction of low-resolution 
image, and according to the result, it proceeds to step S 8 02 when 
new vertical loop counter 1 is smaller than 240 while it terminates 
pixel interpolation of an image when where it is equal to 240. 

The new pixel data Q [2k, 21], Q [2k+l,21], Q [2k, 21+1] and 
Q [2k+l,21+l] which are obtained by the above-described operation 
will be transferred to the upper new pixel line memory 1222 in the 
order of Q[2k,21] , Q[2k+l,21], and transferred to the lower new 
pixel line memory 1223 in the order of Q[ 2k, 21+1], Q[ 2k+l , 21+1 ] . 

In the image processor according to the second embodiment of 
the present invention, the image processor for converting low- 
resolution image to high-resolution image having twice number of 
pixels in both the vertical and horizontal directions includes a 
pixel selection means 113 0 for extracting a pixel of interest, an 
upper pixel, a lower pixel, a left pixel, and a right pixel, the 
vertical subtracter 1115 for calculating the difference in the 
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vertical direction based upon the data of upper and lower pixel , 
the horizontal subtracter 1114 for calculating the difference in 
the horizontal direction based upon the data of left and right pixel, 
the vertical arithmetic device 1117 for calculating the vertical 
correction value based upon the difference in the vertical direction 
and the distance from a pixel of interest to new pixel in the vertical 
direction, the horizontal arithmetic device 1116 for calculating 
the horizontal correction value based upon the difference in the 
horizontal direction and the distance from a pixel of interest to 
new pixel in the horizontal direction, and the new pixel data 
calculator 1235 for calculating the data of new pixel which are 
positioned at upper left, upper right, lower left, and lower right 
of pixel of interest based upon the data of pixel of interest, the 
vertical correction value, and the horizontal correction value, and 
the maintenance means 123 4 for holding the data of new pixel which 
is calculated by the new pixel data calculator 1235 temporarily, 
and outputting the data sequentially from the upper left new pixel 
of high-resolution image, and the position of new pixel is made such 
that the absolute values of the distances from pixel of interest 
are V4 the both the horizontal and vertical directions- This can 
improve the processing speed by reducing the operation amount with 
maintaining the appearance probability of the error of the pixel 
data as well as provide images with sharpness without smoothing edge 
parts of the image. 
(Embodiment 3) 
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The image processor according to a third embodiment is one 
which converts a low-resolution image of horizontal 320 X vertical 
240 pixel to a high-resolution image of horizontal 320Xvertical 
480 pixel with interpolating to twice number of pixels in the vertical 
direction, which is used for image processing for generating a flame 
screen by interpolating a field screen of an interlace signal such 
as NTSC signal which is used for current TV broadcasting. 

Figure 13 is a block diagram showing a construction of the 
image processor according to the third embodiment. 

In figure 13, the same reference numerals denotes the same 
elements as in figure 11 or figure 12, 1333 denotes a new pixel data 
arithmetic means, constructed as follows. 

To be specific numerals 1115 and 1217 denotes the same elements 
in figure 11 or figure 12, 1318 denotes the upper new pixel data 
calculator for calculating the data of new pixel for interpolation 
at upper of pixel of interest, 1320 denotes the lower new pixel data 
calculator for calculating the data of new pixel for interpolation 
to the lower of pixel of interest, 1335 denotes a new pixel data 
calculator which is constituted by the upper new pixel data 
calculator 1318 and the lower new pixel data calculator 1320. 

Further, in the pixel selection means 1330 the image processor 
according to the third embodiment has a configuration having omitted 
the left pixel data buffer 1109 and the left end processing path 
1106 in the pixel selection means 113 0 in figure 12. 

Figure 9 is a diagram illustrating the position of new pixel 
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which is interpolated by the image processor according to the third 
embodiment . 

In figure 9, "O" denotes an original pixel of low-resolution 
image having a pixel interval being -1", "□" denotes a new pixel 
of high-resolution image. Further , a new pixel matches the position 
of original pixel, and is positioned at a point which is distant 
from the original pixel in the vertical direction by 1/4. Have in 
the absolute value, the intensity of original pixels of 901, 902, 
903 and new pixels of 904 and 905 are designated as P901, P902, P903, 
Q904 and Q905. 

According to this pixel arrangement, all the new pixels are 
arranged at equal intervals from the original pixels so as to make 
uniform the appearance probability of error of pixel data. 

Though a large calculation amount is required because it is 
necessity to create all new pixels in the arrangement, by employing 
a similar devise as in the second embodiment of the present invention, 
the operation amount can be suppressed. 

TO be specific ,lf dlfy=( 1/8) (P903-P902) is first calculated 
on the basis of original pixels 901, 902, 903 the arithmetic 
expression for calculating the intensity of new pixels Q904, Q905 

becomes as follows, 

Q904=P901-dif x 
Q905=P901+difx 

and, a number of times required for calculating the intensity Q904 
and Q905 of two new pixels from the intensity P901 of pixel of interest 
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are three times addition or subtraction and one division. 

Hereinafter, an operation of new pixel data arithmetic means 
1333 will be described. 

The vertical subtracter 1115 receives as its input the lower 
pixel data from the lower pixel data buffer 1111, and the upper pixel 
data from the upper pixel data buffer 1113, and subtracts the upper 
pixel data from the lower pixel data, and output the difference in 
the vertical direction to the vertical arithmetic device 1217. The 
vertical arithmetic device 1217 shifts the difference in the 
vertical direction leftward by 3 bits to 1/8 and output the vertical 
correction value to the upper new pixel data calculator 1318 and 
the lower new pixel data calculator 132 0. 

The upper new pixel data calculator 1318 receives as its inputs 
the vertical correction value from the vertical arithmetic device 
1217, and the data of pixel of interest from the pixel of interest 
data buffer 1108, and subtracts the vertical correction value from 
the data of pixel of interest and output the data of new pixel for 
interpolation at the upper of pixel of interest . The lower new pixel 
data calculator 1320 adds the vertical correction value to the data 
of pixel of interest and output the data of new pixel to be 
interpolated at the lower of pixel of interest to the lower new pixel 

line memory 1223. 

The upper new pixel line memory 1222 stores the data of new 
pixel to be interpolated at the upper of pixel of interest by 1 line 
of the high-resolution image, and output all the 1 line in the order 
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of storing- The lower new pixel line memory 12 23 stores the data 
of new pixel to be interpolated at the lower of pixel of interest 
by 1 line of high-resolution image, and output all the 1 line in 
the order of storing, after the upper new pixel line memory 1222 
output the data of 1 line. 

) Hereinafter, an operation procedure of the new pixel data 
arithmetic means 1333 will be described. 

Figure 10 is a flow chart showing an operation procedure for 
performing resolution conversion of horizontal 3200x vertical 240 
pixels to horizontal 32 0 x vertical 480 pixels with interpolating 
to twice number of pixels in the vertical direction in the image 
processor according to the third embodiment of the present 
invention . 

in figure 10, dify, k, 1, Q, P denotes the same elements as 
those in figure 1 or figure 8, and there are relations of 0<k<320, 
0SK240. 

51001 denotes a vertical loop default setting up step for 
setting the initial value to a variable related to the vertical loop, 
which assigns the initial value 0 to the vertical loop counter 1. 

51002 denotes horizontal loop default setting up step for 
setting the initial value to a variable related to the horizontal 
loop, which assigns the initial value 0 to the horizontal loop counter 
k. 

51003 denotes , a correction value calculating step for 
obtaining the correction value in the vertical direction, the 
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vertlcal correction value dify is calculated by o dify-(P[k, 
1+1]-P[k,l-1] )/8. 

51004 denotes a intensity calculating step for obtaining the 
intensity of two new pixels, which calculates the intensity Qtk,21] 
of new pixel to be interpolated at the upper of pixel of interest 
and the intensity Q[k,21+1] of new pixel to be interpolated at the 
lower side of pixel of interest by Q[k, 21]=P[k, l]-dify and 
Q[k,21+l]=P[k,l] + diiy respectively. 

51005 denotes a horizontal loop conclusion judging step for 
judging the conclusion of horizontal loop repeating step SI 00 3 
through S1005, and it compares new horizontal loop counter k obtained 
by adding 1 to the horizontal loop counter k with the number of pixels 
320 in the horizontal direction of low-resolution image, and 
according to the result, it proceeds to step S1003 when where new 
horizonral loop counter k is smaller than 320 while it proceeds to 
step S1006 when it is equal to 320. 

51006 denotes a vertical loop conclusion judging step for 
judging the end of vertical loop repeating step S1002 through siooe, 
and it compares new vertical loop counter 1 obtained by adding 1 
to the vertical loop counter 1 with the number of pixels 240 in the 
vertical direction of low-resolution image, and according to the 
result, it proceeds to step S1002 when new vertical loop counter 
1 is smaller than 240 while it terminates a pixel interpolation of 
an image when it is equal to 24 0. 

New pixel data Q[k,21] and Q[k f 21+1] are calculated by the 
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above-mentioned operation procedure, and Q[k,21] is transferred to 
the upper new pixel line memory 1222 and Q[k,21+1] is transferred 
to the lower new pixel line memory 1223. 

Accordingly, in the image processor according to the third 
embodiment of the present invention, the image processor for 
converting low-resolution image to high-resolution image having 
twice number of pixels in the vertical direction includes a pixel 
selection means 1330 for extracting a pixel of interest, an upper 
pixel, and a lower pixel, the vertical subtracter 1115 for obtaining 
the difference in the vertical direction on the basis of the data 
of upper and lower pixel, the vertical arithmetic device 1217 for 
calculating the vertical correction value on the basis of the 
difference in the vertical direction and the distance from a pixel 
of interest to new pixel in the vertical direction, the new pixel 
data calculator 1335 for calculating the data of new pixel which 
are positioned at the upper and the lower of pixel of interest on 
the basis of the data of pixel of interest and the vertical correction 
value, and the maintenance means 1234 for holding the data of new 
pixel which is calculated by the new pixel data calculator 1335 
temporarily and outputting the data sequentially from the upper left 
new pixel of high-resolution image, and the position of new pixel 
is made such that the absolute value of the distance from pixel of 
interest in the vertical direction is 1/4, thereby improving 
processing speed with making uniform the appearance ratio of error 
of pixel data and further reducing the amount of calculation, as 
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well as obtaining an high-quality image with sharpness without edge 
parts of the image being smoothed . 

Though in the above first to third embodiments a pixel data 
is assumed to be only intensity data ,the pixel data may be color 
data or color difference date of RGB, GMYK, and the like ,with the 
same effect described above are obtained. 

Further, in the first to third embodiments an image processor 
and an image processing method as an operation flowchart are 
described, these can be realized by a computer program which is 
recorded in a recording medium such as ROM, and operates similarly 
as the image processing method in the first to third embodiments 
with the same effects obtained. 
APPLICABILITY IN INDUSTRY 

As mentioned above, the image processor, the image processing 
method and the image processing program recording medium according 
to the present invention can obtain high-quality image with 
sharpness in spite of requiring a less amount of interpolation 
arithmetic to increase an image resolution, short processing time 
and small scale hardware, and further, it is possible to make uniform 
the appearance probability of error of employing a pixel data when 
a pixel arrangement which minimizes the arithmetic operation amount. 



